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INTRODUCTION 


1. 

l.l  Visual  Acquisition  as  a Moans  of  Separation  Assurance 

In  the  first  few  decades  of  flight  safe  separation  between  aircraft 
was  achieved  almost  entirely  by  visual  means.  However,  as  aircraft  speeds 
and  traffic  densities  increased  and  as  aircraft  flew  more  often  under  con- 

V. 

ditions  of  restricted  visibility,  the  need  for  alternative  means  of 
separation  assurance  became  apparent.  As  a result  a system  of  airspace 
structure  and  active  Air  Traffic  Control  (ATC)  began  to  evolve.  Today  an 

a"* 

extensive  ATC  system  employing  thousands  of  controllers  exists  in  the 
United  States  with  the  primary  objective  of  preventing  collisions  (or 
interference)  between  aircraft.  This  ATC  system  has  been  highly  effective 
in  ensuring  separation  between  aircraft  which  participate  fully  in  the 
system  by  filing  flight  plans  and  flying  under  Instrument  Flight  Rules  (IFR) . 
Unfortunately  a large  number  of  general  aviation  aircraft  do  lot  or  cannot 
participate  at  this  level  (often  because  of  the  expense  of  required  avionics 
or  the  lack  of  necessary  pilot  training) . These  aircraft  must  operate 
under  Visual  Flight  Rules  (VFR)  witli  essentially  no  help  from  the  ATC 
system  (except  for  traffic  advisories  issued  on  a "workload  permitting" 
basis  which  means  that  they  are  generally  unavailable  when  most  needed). 

When  IFR  and  VFR  aircraft  must  share  the  same  airspace,  then  all  pilots 
must  exercise  "see-and-avo id " techniques  in  order  to  ensure  safety.  The 
control  problems  which  result  from  sucli  mixing  of  controlled  and  uncontrolled 
aircraft  have  resulted  in  a trend  toward  exclusion  of  uncontrolled  aircraft 
from  more  and  more  segments  of  airspace.  A genuine  concern  exists  that 
this  trend  will  greatly  erode  the  viability  of  VFR  flight  as  a flexible 
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and  economical  means  ot  air  transportation.  Issues  such  as  these  have  -J 


! 

created  a need  for  understanding  pilot  visual  see-and-avoid  performance  in 
order  to  evaluate  current  safety  practices  and  to  explore  options  for 
future  ATC  system  development. 

For  many  reasons  to  be  discussed  more  fully  later,  see-and-avoid  as 
currently  practiced  is  far  from  totally  reliable  as  a means  of  separation 
assurance.  Various  approaches  such  as  improved  pilot  training,  airspeed 
limitations,  and  aircraft  conspicuity  enhancement  have  been  taken  to 

I 

improve  performance.  Recently  serious  efforts  have  been  directed  toward 


the  development  of  a pilot  warning  (or  proximity  warning)  instrument  (PWI) 
which  would  alert  the  pilot  to  the  presence  of  a collision  hazard  and 
assist  him  in  visually  locating  the  aircraft  in  question.  In  particular, 
PWI  is  an  integral  part  of  the  Intermittent  Positive  Control  (IP C)  colli- 
sion avoidance  system  which  the  FA/'  has  proposed  for  implementation  in  the 
next  decade. 

In  the  development  of  the  PWI  concept  several  questions  have  emerged 
as  being  of  major  concern: 

How  effective  is  the  current  see-and-avoid  doctrine  in  ensuring 

separation? 

How  effective  would  a PWI  system  be? 

Is  PWI  compatible  with  other  separation  assurance  services  (e.g., 

IPC  avoidance  commands)? 

A basic  goal  of  research  In  this  area  has  been  the  formulation  of  a 
mathematical  model  which  reliably  reflects  the  air-to-air  visual  acquisi- 
tion capabilities  of  pilots.  One  approach  to  the  construction  of  such  a 
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model  is  to  adapt  laboratory  data  characterizing  human  visual  performance 
at  the  neurological  level  into  an  appropriate  higher  level  model.  More 
direct  approaches  have  involved  ground-based  experiments  in  which  pilots 
attempt  to  acquire  targets  projected  upon  screens  while  flying  aircraft 
simulators.  Both  of  these  approaches  are  useful,  but  the  many  discrepan- 
cies between  the  visual  stimuli  of  the  laboratory  and  the  actual  environ- 
ment make  model  validation  under  field  conditions  essential  before 
confidence  can  be  placed  in  the  results. 

In  this  study  two  sets  of  data  gathered  under  actual  flight  conditions 
are  examined.  The  second  set  of  data,  that  gathered  during  the  IPC/PWI 
flight  tests  at  the  M.I.T.  Lincoln  Laboratory,  is  of  particular  interest 
in  that  it  involves  typical  pilots  utilizing  an  actual  PWI  instrument  (as 
opposed  to  the  first  set  of  data  which  involves  test  pilots  informed  of 
traffic  by  other  means).  Our  analysis  will  be  directed  toward  finding  the 
simplest  model  which  adquately  reflects  the  essential  features  of  air-to- 
air  visual  acquisition  performance.  This  model  will  then  be  used  to  derive 
predictions  of  visual  acquisition  performance  for  a variety  of  conditions. 

1 . 2 The  Nature  of  the  Visual  Acquisition  Task 

The  success  of  avoidance  by  visual  means  depends  upon  the  proper 
performance  by  the  pilot  of  an  extremely  difficult  series  of  tasks.  In 
addition  to  his  other  cockpit  duties,  the  pilot  must  detect  approaching 
threats,  evaluate  the  situation,  and  react  in  an  appropriate  manner.  In 

most  cases  where  see-and-avoid  fails  it  appears  that  "seeing"  (acquisition) 

★ 

either  did  not  occur  or  occurred  too  late  for  effective  pilot  reaction  . 

* 

There  are,  however,  a few  documented  cases  where  the  pilot  chose 
ineffective  avoidance  maneuvers  even  though  detection  had  occurred  with 
adequate  lead  time.  (e.g.,  Carmel,  New  York;  December  1965). 


3 


r 


i 


Acquisition  performance  is  primarily  a function  of  the  following  major 
factors : 

1.  Search.  The  term  search  refers  to  the  scanning  of  the  pilot's 
1 ine-of-sight  through  the  angular  field  of  possible  target 
locations  in  an  attempt  to  acquire  the  target.  When  occupied 

by  other  cockpit  duties  the  pilot  cannot  give  constant  attention 

to  the  visual  search  for  traffic.  Unless  provided  with  specific 

information  a pilot  may  concentrate  his  search  in  directions 

* 

other  than  the  direction  of  the  threat  . Under  certain  circum- 
stances even  a few  seconds  inattention  can  mean  the  difference 
between  an  adequate  and  inadequate  acquisition  time. 

2.  Field  of  View.  The  typical  airplane  cockpit  allows  unobstructed 
view  of  only  a fraction  of  possible  approach  directions.  For 
slower  aircraft  which  may  be  overtaken  from  behind  this  is  an 
important  consideration. 

3.  Detectability . The  term  detectability  refers  to  those  visual 
factors  which  determine  whether  a target  will  be  seen  which  is 
in  the  searching  pilot's  field  of  view.  In  optical  terms,  the 
major  factors  are  the  target  apparent  size  and  the  contrast  of 
the  target  with  its  background.  Other  factors  such  as  target 
motion  with  respect  to  the  background  may  be  considered  in  this 
category. 

4.  Speed  of  Approach.  The  speed  of  approach  determines  the  time 
available  for  detection,  and  it  is  convenient  to  treat  it  as  a 
separate  independent  factor. 

* 

One  problem  is  that  of  fixation  upon  one  nearby  aircraft  at  the  same 
time  that  another  more  serious  threat  is  approaching  from  another  direction. 
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Attempts  to  improve  visual  acquisition  performance  may  be  classified 
in  terms  of  their  impact  upon  the  four  factors  listed  above. 

1 . 3 PWI  as  an  Aid  to  Visual  Acquisition 

Pilot  warning  instruments  (PWI)  are  intended  to  aid  the  pilot  in  the 
visual  acquisition  task.  Typically  the  approaching  traffic  is  detected  by 
electronic  means,  and  the  pilot  is  presented  with  information  concerning 
the  approach  bearing  and/or  altitude  of  the  threat.  Fig.  1-1  depicts  the 
PWI  display  currently  associated  with  the  Intermittent  Positive  Control  (IPC) 
system.  The  outer  ring  of  36  lights  correspond  to  three  possible  altitude 
bands  (below,  co-altitude,  above)  at  12  clock  positions  (30°  sectors). 

Lights  may  be  displayed  as  steady  or  flashing  depending  upon  the  time  avail- 
able for  avoidance.  The  central  part  of  the  display  provides  collision 
avoidance  commands.  The  relationship  of  the  PWI  function  to  the  collision 
avoidance  function  will  be  discussed  in  Section  6. 

The  primary  intent  of  PWI  is  to  improve  the  search  performance  of  the 
pilot.  The  PWI  alarm  ensures  that  scanning  will  be  given  high  priority 
when  it  is  most  critical  and  by  directing  the  pilot's  search  to  a particular 
sector,  the  area  to  be  scanned  is  greatly  reduced.  Another  effect  dis- 
covered in  the  IPC/PWI  flight  tests  is  the  tendency  of  PWI  to  reduce  the 
effect  of  airframe  obstruction.  Not  only  do  pilots  shift  their  positions 
within  the  cockpit  in  an  effort  to  scan  a threat  sector,  but  many  pilots 
alter  the  aircraft  attitude  in  order  to  achieve  an  unobstructed  view  in 
the  threat  direction.  Thus,  PWI  favorably  affects  the  first  two  elements 
of  acquisition  (search  and  field  of  view).  It  does  not  alter  detectability 
or  speed  of  approach  in  any  direct  way. 
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2.  AIR-TO-AIR  VISUAL  ACQUISITION 

2 . 1 Approach  to  Modelling  Visual  Acquisition  Performance 

The  model  of  visual  acquisition  performance  which  is  developed  in 
this  study  is  intended  to  facilitate  an  understanding  of  flight  test 
results  and  to  provide  a means  for  mathematical  analysis  of  visual  acquisi- 
tion performance  and  PWI  design.  It  will  be  shown  that  a highly  simplified 
model  of  the  acquisition  process  is  adequate  for  these  purposes  and  that 
such  a model  can  be  adapted  to  various  flight  conditions.  The  following 
discussion  identifies  the  manner  in  which  the  essential  elements  of  the 
actual  process  are  incorporated  into  the  model. 

2 . 2 The  Visual  Search  Process 

Under  normal  daylight  visual  conditions  the  probability  of  acquisition 
decreases  with  angular  distance  of  the  target  from  the  observer’s  line  of 
sight.  This  is  due  to  the  fact  that  the  acuity  of  human  vision  is  greatest 
when  the  object  image  falls  upon  the  portion  of  the  retina  known  as  the 
fovea  where  the  density  of  visual  cones  is  greatest.  The  visual  search 
process  may  be  viewed  as  the  movement  of  the  line  of  sight  from  one  posi- 
tion to  another  in  an  attempt  to  bring  this  line  near  enough  to  the  target 
to  allow  detection. 

Two  major  questions  which  must  be  considered  are  the  amount  of  time 
the  pilot  devotes  to  searching  for  traffic  and  the  angular  distribution 
of  his  search  time. 

Angular  Distribution  of  Search 

Howell  (Reference  4)  found  that  unalerted  pilots  tended  to  concentrate 
their  glances  in  the  forward  direction  (within  30°  of  straight  ahead) , but 
that  pilots  who  were  informed  that  they  were  on  a collision  course  spread 
their  glances  more  evenly  over  the  visible  area.  If  the  pilot  possesses 
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a PW1  system  which  directs  him  to  search  a limited  area,  it  is  likely  that 
his  glances  will  be  distributed  uniformly  over  that  region.  In  the  calcu- 
lations to  be  presented  later,  it  is  generally  assumed  that  search  effort 
is  uniform.  It  should  be  kept  in  mind  that  this  assumption  may  require 
modification  when  applied  to  unalerted  search. 

Size  of  Search  Area 

For  PWI  systems  it  is  generally  assumed  that  the  size  of  the  search 
area  is  directly  related  to  the  resolution  of  the  PWI  bearing  information. 
In  practice  pilots  must  allow  for  error  in  the  PWI  information  due  to 
measurement  errors,  wind  (crab  angle),  quantization,  projection  of  sector 
boundaries  upon  the  environment,  etc.,  and  the  resulting  search  area  may 
vary  considerably  from  individual  to  individual. 

Time  Devoted  to  Search 

The  percentage  of  time  which  a pilot  devotes  to  looking  outside  the 
cockpit  has  bee.'  found  to  vary  from  a low  of  22%  for  air  carrier  operations 
to  a high  of  52%  for  certain  categories  of  small  aircraft  flight  (Refer- 
ence 2).  These  figures  represent  only  an  upper  bound  on  the  proportion  of 
time  which  is  spent  actively  scanning  for  traffic,  since  much  of  the  time 
spent  looking  outside  may  be  devoted  to  observing  the  weather  or  just 
sightseeing.  In  flight  tests  at  Lincoln  Laboratory  it  was  estimated  that 
after  PWI  alarms  were  noted,  pilots  devoted  approximately  95%  of  their  time 
to  the  search  for  traffic. 

A Search  Model 

A standard  approach  to  modelling  the  search  process  is  the  following: 
consider  a search  area  S with  a target  of  negligible  angular  extent  located 
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within  this  area.  The  search  process  consists  of  the  movement  of  the  line 
of  sight  from  place  to  place  within  the  search  area  in  a series  of  fixa- 
tions, each  of  duration  t.  Such  fixations  are  often  referred  to  as  "glimpses". 
The  probability  that  the  target  will  be  detected  in  a given  glimpse  depends 
upon  the  properties  of  the  target  itself  (size,  contrast,  etc.)  and  the 
angular  distance  of  the  target  from  the  line  of  sight.  For  a given  target 
the  detection  probability  is  usually  visualized  in  terms  of  an  equivalent 
area,  a,  defined  by: 


a = / P(e)  2tt6  de 


Where  P(0)  = single  glimpse  probability  of  detection  for  a target  at 
an  angle  0 from  the  line  of  sight.  The  single  glimpse  probability  of 
detection  is  then  a/S.  If  glimpse  directions  are  distributed  at  random 
over  a search  area  large  with  respect  to  a,  one  may  define  an  acquisition 
rate  a/St  which  then  totally  characterizes  visual  acquisition  performance. 

It  is  important  to  note  that  although  the  detection  area  may  vary  in  a com- 
plicated manner  as  the  target  characteristics  change,  the  effect  of  the  search 
area  S is  merely  to  alter  the  acquisition  rate  by  a fixed  fraction. 

2 . 3 Effects  of  Target  Size  and  Contrast 

Laboratory  studies  have  shown  that  visual  detection  thresholds  are 
principally  a function  of  the  product  of  target  apparent  size  and  target 
contrast  with  background  (Reference  3).  Often  other  considerations  such  as 
target  shape  and  color  can  be  modelled  as  altering  the  effective  area  or 


contrast . 
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For  a target  presenting  a visible  area  A at  a range  r the  apparent 

size  can  be  defined  in  terms  of  the  solid  angle  subtended  by  the  target, 

2 

A/r  . This  apparent  size  is  influenced  by  the  following  factors: 

(a)  Range-  Solid  angle  varies  inversely  as  the  square. 

(b)  Aspect  angle-  The  visible  area  is  generally  less  when 
the  aircraft  is  viewed  head-on  than  when  it  is  viewed  broad- 
side, The  broad  surface  of  the  wings  is  not  visible  unless 
the  target  is  viewed  away  from  the  horizontal  or  unless  the 
target  banks.  In  flight  tests  at  Lincoln  Laboratory,  the 
target  sometimes  went  undetected  until  it  rolled  into  a 
turn,  at  which  point  it  was  immediately  detected. 

(c)  Aircraft  size-  The  visible  area  is  generally  proportional  to 
the  actual  size  of  the  aircraft. 

Target  contrast  is  affected  by  many  factors  and  may  vary  in  an  unpre- 
dictable manner  during  a single  encounter.  The  term  "contrast"  is  employed 
in  a general  sense  to  include  those  effects  which  make  the  total  luminance 
(brightness)  of  the  target  area  differ  from  that  of  an  equal  area  of  back- 
ground. In  tnis  general  sense  contrast  is  affected  by  the  following  fac- 
tors : 

(a)  Background  luminance  - This  is  primarily  a function  of  the 
brightness  of  the  sun  and  the  position  of  the  sun  with 
respect  to  the  aircraft.  The  same  aircraft  may  appear  as 
light  or  dark  depending  upon  the  angle  of  approach  with 
respect  to  the  sun.  During  the  1PC/PWI  flight  tests,  the 
test  pilots  pointed  out  that  a slight  amount  of  haze  behind 
the  aircraft  presented  a white  background  which  made  acquisi- 
tion easier  than  under  the  blue  background  conditions  of 
unlimited  visibility. 
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(b)  Reflections  - Sunlight  glinting  off  aircraft  may  aid 
detection,  especially  if  aircraft  turns  and  thus  rotates 
the  directions  of  specular  reflections. 

(c)  Background  complexity  - The  aircraft  is  usually  easier  to 
detect  against  a uniform  background  of  sky  rather  than  a 
complex  terrain  background.  Properties  of  terrain  background 
may  vary  with  the  season  from  summer  green  to  autumn  gold 

to  winter  white. 

(d)  Atmospheric  visibility  - The  presence  of  haze  of  fog  between 

the  pilot  and  target  results  in  an  effective  lowering  of 

contrast.  The  magnitude  of  the  effect  is  normally  assumed 

-3.92  r 

to  vary  according  to  e — where  R is  the  atmospheric 

K 

visibility  and  r is  the  range  to  the  target. 
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3 • ACQUISITION  PERFORMANCE  ANALYSIS  AND  MODELLING  TECHNIQUES 

3.1  A cquisition  as  a Nonhomogenous  Poiss on  Proce ss 

The  results  of  visual  acquisition  experiments  are  often  presented  in 
terms  of  the  cumulative  probability  of  acquisition  by  a given  range,  time, 
etc.  Different  approach  speeds  or  visual  conditions  produce  different 
curves,  and  it  is  usually  difficult  to  perceive  the  nature  of  the  common 
acquisition  process  which  underlies  all  such  curves.  In  this  section  a 
mathematical  model  of  the  visual  acquisition  process  will  be  developed 
which  allows  data  collected  under  a wide  variety  of  conditions  to  be 
analyzed  in  a common  framework.  Cumulative  acquisition  probability  curves 
will  then  be  derived  from  this  model. 

A simple  yet  highly  adaptable  approach  is  to  assume  that  acquisition 
is  a random  process  which  may  be  described  in  terms  of  the  probability  of 
acquisition  per  unit  time,  hereafter  referred  to  as  the  acquisition  rate. 

The  acquisition  rate  is  denoted  \(x)  where  x(t)  is  a vector  whose  components 

are  k variables  upon  which  the  acquisition  rate  depends.  As  defined  here, 

* 

acquisition  is  a nonhomogenous  Poisson  process  in  which  the  first  arrival 
(event)  corresponds  to  acquisition  and  terminates  the  trial. 

Other  authors  sometimes  present  visual  detection  data  in  terms  of  a 
"single-glimpse  probability  of  detection".  The  relation  of  this  quantity 
to  acquisition  performance  is  dependent  upon  the  time  duration  associated 
with  a "glimpse".  By  modelling  acquisition  as  a continuous  process  it  is 
assumed  that  only  the  time-averaged  acquisition  effort  is  needed  to  charac- 
terize performance  and  one  need  not  be  concerned  with  defining  the  duration 
of  a glimpse. 

•k 

in  the  classic  homogenous  Poisson  process,  the  arrival  rate  is  assumed  to 
be  constant.  All  equations  derived  herein  for  the  nonhomogenous  process 
reduce  to  the  classic  equations  when  \ is  a constant. 


i 
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3.1.1  Relationship  Between  Acquisition  Rate  and  Cumulative 
Acgu is ition  Probability 

The  manner  in  which  various  properties  of  the  acquisition  process 
can  be  derived  from  a knowledge  of  X will  now  be  demonstrated.  For  con- 
venience the  symbol  X(t)  will  be  utilized  in  place  of  X (x  (t))  for  trials 
in  which  the  time  history  of  x (and  consequently  of  X)  are  defined. 

Define  the  cumulative  probability  of  acquisition,  F(t),  as  the  probability 
that  acquisition  occurs  at  a time  less  than  or  equal  to  t.  The  probability 
density  function  for  the  acquisition  time  is  then  f(t)  = dF/dt|t.  Consider 
a small  time  interval  At  centered  at  time  t.  The  probability  that  acquisi- 
tion will  occur  in  this  interval  is  approximately  f(t)  At.  But  this 
probability  is  also  equal  to  the  probability  that  acquisition  did  not  occur 
before  t multiplied  by  the  probability  that,  given  rate  X(t),  acquisition 
will  occur  in  a duration  At,  i.e. 

f(t)  At  = [1  - F ( t ) ] X(t)  At  as  At  + 0 (3-1) 

The  resulting  differential  equation 

dF/dt  = [1  - F( t ) ] X(t) 


has  solution 


F(t)  = 1 - exp 


t 

f 


MO  df. 


= 1 - exp  [ -n ] , where  n 


I 


MO  dt 


(3-1) 


and  consequently 


f (t)  = “jr  = \ (t)  exp  | -n  1 


(1-3) 
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It  is  instructive  to  note  that  for  the  usual  Poisson  process  the 


quantity  n,  the  integrated  acquisition  rate,  is  the  expected  number  of 
arrivals  occuring  by  time  t. 

As  will  be  seen  in  Section  4.1,  it  is  possible  in  certain  simple 
cases  to  plot  A (it)  directly  from  the  data  without  postulating  a specific 
parametric  dependence  upon  x.  However  a matematical  technique  for  finding 
a "best  fit"  expression  is  desirable  for  the  following  reasons: 

(1)  Multi-variable  dependences  can  be  conveniently  examined. 

(2)  A mathematical  expression  for  use  in  theoretical  calculations 
is  then  available. 

(3)  An  error  analysis  can  be  performed  upon  the  estimated  parameters 
in  order  to  evaluate  the  significance  of  differences  between 
various  sets  of  data. 

3.1.2  A Linear  Form  for  Acquisition  Rate 
Suppose  that  k variables  upon  which  the  acquisition  rate  depends  have 
been  identified.  Let  \ be  modelled  as  a linear  function  of  those  variables, 

i .e . 


> (x)  = 


K 

E 


LX.  = 

l l 


Bixi  + 


62X2  + 


B.X, 
k k 


i=l 

where  the  B.  are  parameters  to  be  determined,  by  proper  definition  of 

the  variables  X.  this  model  may  be  adapted  to  a variety  of  forms  which 

are  decidedly  non-linear  with  respect  to  the  original  data.  For  example, 

2 

if  range  is  a given  quantity,  define  X^  = 1/r  and  thus  obtain  a linear 
form  which  models  a dependence  upon  the  inverse  square  range.  Further- 
more note  the  correspondence  of  the  following  forms: 


i 1 

\ 


• 1 

' 


* 

[ 

\ 

I 

1 i 
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!1X1  + B2X2 


and 


51X1  + S2X2 


' 2 ' ,2 

where  = X^/ r and  = X^/r  . 


(3-5) 


Of  considerable  computational  significance  is  the  fact  that  the 
integral  n of  equation  (3-2)  is  now  separable  in  8,  i.e. 


, k 

" ■/ <x)dt  6i / xi 

1=1 


(t)  dt 


(3-6) 


3.2  Maximum  Likelihood  Est  imat  ion  of  Model  Parameters 

In  order  to  estimate  the  values  of  the  parameters  B.  which  best  fit 

J 

the  data,  the  method  of  maximum  likelihood  will  be  utilized.  This  method 

attempts  to  find  those  values  of  8.  which  maximize  the  computed  probability 

of  obtaining  the  given  set  of  experimental  results. 

Suppose  that  trial  i begins  at  time  t=0  and  continues  until  either 

acquisition  occurs  or  until  some  "break-off"  time  t=T.  is  reached.  The 

addition  of  the  break-off  time  allows  one  to  study  experimental  trials 

which  were  not  pursued  to  acquisition  or  to  study  only  specific  periods 

within  trials.  It  may  be  seen  by  reference  to  equation  3-2  that  the 

probability  of  termination  at  t=T^  (without  acquisition)  is 

T. 


exp  [-n(Tj)]  where  r i ( T t ) = 1 \(t,)  df; 

J0 

For  those  trials  in  which  the  termination  time  is  within  the 
0 to  T (with  acquisition)  the  probability  density  (from  equation 


l(t)  exp  [ — n ( t ) ] 0 < t < T. 


(3-7) 

interval 
3-3)  is 

(3-8) 
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Thus  the  probability  density  of  termination  times  has  both  discrete 


and  continuous  components  and  is  given  by 


exp  l — r)  ( t ) ] t = T.  (discretely) 

1 (3-9) 

A(t)  exp  (-n(t)  ] 0 t < (continuously) 

0 elsewhere 

Kor  n independent  trials  the  likelihood  function  which  is  to  be 
maximized  is  just  the  product  of  the  n individual  functions  evaluated  at 
the  observed  termination  times  and  may  be  written 


L(t1,  t2 tR)  = exp  t -n  ( t ± ) ] 

no 

acqisition  acquisition 

where  t.  is  the  termination  time  for  trial  i (equal  to  T . if  the  trial 
l i 

ended  without  acquisition  but  within  the  interval  0 to  otherwise) . 


expression  is  detailed.  It  is  shown  that  for  the  simple  case  in  which  A 
depends  upon  only  one  variable,  i.e.,  A(x)  = the  maximum  likelihood 
estimate  of  8^  is 


j.j  A(Ci)  °XP  f-r'(ti)]  (3-10) 


8 = - 


(3-11) 


where  N is  the  number  of  the  n trials  which  ended  in  acquisition  and  t^ 
is  the  termination  time  for  trial  i.  This  result  will  prove  immediately 


useful  in  the  next  section. 


4. 


examination  ok  a previous  study 


4 . 1 Interpretation  of  CPC  Flight  Test  Data 

In  early  1972  the  Control  Data  Corporation  conducted  a series  of 
photographic  flights  to  obtain  film  for  use  in  a visual  detection  simu- 
lation. During  these  flights  the  ranges  at  which  the  pilots  in  each 
aircraft  detected  the  other  was  recorded.  A table  of  detection  ranges  and 
approach  speeds  is  given  in  Reference  5 and  this  data  will  be  examined 
in  order  to  compare  these  results  to  those  obtained  during  the  IPC/PWI 
flight  tests.  In  presenting  this  data,  the  following  experimental  condi- 
tion should  be  noted: 

- For  photographic  reasons,  the  geometry  of  the  encounter  was 
controlled  so  that  one  of  the  aircraft  being  photographed  would 
approach  from  the  9 to  12  o'clock  position  and  did  not  approach 
from  the  sun. 

- All  encounters  were  flown  at  an  altitude  separation  of  500  feet. 

- The  pilots  were  aware  of  the  encounter  geometry  and  were  familiar 
with  the  appearance  of  the  other  aircraft. 

One  factor  which  is  not  known  with  regard  to  the  CDC  data  is  the 
visual  search  area  which  had  to  be  scanned  in  order  to  detect  the  target. 
This  area  depends  upon  the  precision  with  which  the  pilot  could  anticipate 
the  approach  bearing  of  the  other  aircraft.  This  point  will  be  mentioned 
later  when  the  CDC  data  is  compared  to  the  data  gathered  in  the  Lincoln 
flight  tests. 

The  range  dependence  of  the  acquisition  rate  can  be  extracted  from 
the  available  tabular  data  in  the  following  non-parametr ic  manner:  divide 

the  range  axis  into  intervals  of  widLh  Ar.  For  each  interval  determine 
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the  total  time  during  which  an  undetected  target  was  in  that  interval  and 
the  number  of  detections  which  occurred  in  that  interval.  Then  the  estimate 
of  the  acquisition  rate  for  the'  interval  is  given  by 


acquisition  rate 


cal  no.  detections  in  interval 
total  time  in  interval 


The  choice  of  the  interval  width  Ar  is  arbitrary,  but  should  repre- 
sent an  appropriate  balance  between  the  granularity  of  the  estimate  and  the 
number  of  data  points  available  for  smoothing. 

Three  aircraft  were  involved  in  the  CDC  flights,  and  the  resulting 

detection  rate  curves  for  each  are  presented  in  Figs.  4-1,  4-2,  and  4-3. 

2 

In  each  case  a curve  of  form  6/ r (8  = constant)  is  presented.  The  cor- 
respondence between  the  curves  and  the  data  is  striking.  Recall  from  sec- 
tion 2.3  the  assertion  that  detectability  is  mainly  a function  of  the  product 

2 

of  size  and  contrast.  These  results  suggest  that  the  8/r  curve  represents 

this  product.  Note  for  instance  that  the  Musketeer  and  Aztec  are  of  length 

25  and  30  feet,  respectively,  while  the  Gulf  Stream  is  of  length  80  feet. 

If  one  assumes  that  the  visible  area  is  roughly  proportional  to  the  length 

2 

squared,  then  the  ratio  of  visible  areas  is  (80/25)  = 10.24.  This  is 
approximately  the  ratio  of  the  observed  coefficient  8 for  the  Gulf  Stream 
vs.  the  smaller  aircraft.  Thus  the  data  collected  during  the  CDC  photo- 
graphic flights  suggests  that  for  fully  informed  and  alerted  professional 
pilots  searching  continuously  for  known  traffic,  the  acquisition  rate 
increases  inversely  as  the  square  of  the  target  range.  Data  concerning  the 
performance  of  subject  pilots  who  were  informed  of  approaching  traffic  by 
PWI  systems  will  now  be  examined. 


j 


- 


18 


A 


i 


4.2  Results  of  Photographic  Simulation 

The  film  produced  by  the  photographic  test  flights  was  utilized  in 
a visual  detection  simulation  conducted  at  the  DOT  Transportation  System 
Center  in  Cambridge,  Mass.  (Reference  6).  Subject  pilots  selected  from 
the  aviation  community  flew  a GAT  simulator  while  slides  depicting  the 
view  outside  the  cockpit  were  projected  onto  a set  of  screens  surrounding 
the  cockpit.  The  results  of  this  study  are  presented  in  terms  of  a cumu- 
lative probability  of  detection  for  given  time-to-closest  approach,  t^ . 

If  it  is  assumed  that  the  range  between  aircraft  is  roughly  proportional 

to  t , then  one  might  expect  to  observe  an  acquisition  rate  proportional 
c 

2 

to  1/t  . The  acquisition  rate  observed  in  the  simulation  study  may  be 

c 

derived  from  the  curve  of  cumulative  probability  of  detection  via  equa- 
tion (3-1).  The  rate  so  derived  is  shown  in  Fig.  4-4.  Note  that  although 
the  acquisition  rate  initially  follows  the  inverse  square  form  at  larger 
t , the  acquisition  rate  appears  to  drop  at  small  t . This  counter-intuitive 
behavior  must  be  understood  in  terms  of  the  differences  between  the  ideal 
conditions  for  acquisition  to  which  the  inverse  square  performance 
corresponds  and  tiie  non-ideal  cases  which  may  arise  in  other  situations. 

In  order  to  illustrate  this  point,  consider  a case  in  which  90%  of 
the  pilots  are  able  to  make  an  effective  search  for  traffic  and  10%  cannot. 
The  reasons  for  being  unable  to  search  effectively  are  many.  The  pilot 
may  be  experiencing  difficulty  in  flying  the  aircraft  and  may  be  concen- 
trating upon  flying  to  the  virtual  exclusion  of  scanning  for  traffic,  or 
the  direction  of  approach  of  the  target  may  be  obstructed.  In  the  film- 
based  simulation,  the  target  sometimes  passed  out  of  the  field  of  view  of 
the  camera  before  reaching  the  point  of  closest  approach.  At  large  t 
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when  few  acquisitions  have  yet  occurred,  the  observed  total  acquisition 
rate  is  dominated  by  the  90%  of  the  population  which  searches  effectively. 

At  small  t however,  almost  all  of  the  effective  searchers  have  acquired 

c 

and  the  observed  rate  is  dominated  by  those  pilots  who  are  having  special 
difficulties  in  acquiring.  In  any  statement  concerning  overall  visual 
performance,  it  is,  therefore,  important  to  specify  the  proportion  of  cases 
in  which  acquisition  is  degraded  from  that  corresponding  to  the  ideal  situ- 
ation. 
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5.0  MODEL  DEVELOPMENT  BASED  UPON  IPC  FLIGHT  TESTS 


5.1  Lincoln  Laboratory  IPC  Flight  Testis 


During  1975  and  1976  a number  of  pilots  selected  from  the  general 
aviation  community  were  invited  to  participate  in  the  Intermittent  Positive 
Control  (IPC)  flight  test  program  conducted  at  the  M.I.T.  Lincoln  Laboratory. 
Although  the  principal  goal  of  these  tests  was  validation  of  a particular 
collision  avoidance  system,  the  data  collected  and  the  IPC  data  base 
capability  developed  at  Lincoln  Laboratory  can  be  used  to  obtain  valuable 
insight  into  the  ability  of  pilots  to  visually  acquire  traffic  under  actual 
flying  conditions. 

5.1.1  The  IPC/PWI  System 


Intermittent  Positive  Control  (IPC)  is  an  automated  ground-based  colli- 
sion avoidance  system  which  utilizes  the  radar  position  reports  of  the 
Discrete  Address  Beacon  System  (DABS)  in  order  to  detect  potential  collision 
hazards.  Collision  avoidance  messages  are  transmitted  to  aircraft  via  the 
DABS  data  link  and  displayed  via  the  special  IPC  display  shown  in  Fig.  1-1. 
Two  levels  of  service  are  available:  PW1  and  commands.  PWI  information  is 

displayed  in  an  outer  ring  of  lights  arranged  in  twelve  groups  of  three 
which  correspond  to  the  threat  clock  position  (12  o'clock  straight  ahead, 

3 o'clock  off  right  wing,  etc.)  and  the  threat  relative  altitude  (top 
light  for  threat  500  to  2000  feet  above,  middle  light  for  500  feet  above 
to  500  feet  below,  bottom  light  for  500  feet  below  to  2000  feet  below). 

PWI  lights  at  any  position  may  be  of  two  types:  ordinary  (steady)  indicating 

traffic  which  is  nearby  but  not  urgent,  and  flashing  indicating  traffic 
which  presents  an  imminent  hazard.  An  aural  alarm  (tone)  occurs  whenever 
a PWI  alert  appears  for  the  first  time.  Avoidance  commands  are  displayed 


via  arrows  (signifying  the  direction  in  which  a pilot  should  turn  or  change 
altitude)  and  X's  (signifying  that  a pilot  should  refrain  from  turning  or 
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changing  altitude  in  the  indicated  direction). 

The  IPC  algorithm  (Reference  10)  which  resides  in  the  ground  computer 
issues  alarms  based  upon  violation  of  certain  range  and  time-to-collision 
thresholds.  These  thresholds  are  chosen  so  that  commands  normally  appear 
15  seconds  or  more  after  the  first  PWI  alarm. 

5.1.2  Flight  Test  Methodo logy 

Subject  pilots  were  selected  to  represent  a wide  range  of  aviation 
backgrounds  and  levels  of  experience.  Each  pilot  was  given  a brief  period 
to  familiarize  himself  with  the  test  aircraft  and  then  was  asked  to  fly  a 
simple  cross-country  course  of  about  one  hour  duration.  During  this  flight 
an  interceptor  aircraft  conducted  6-7  intercepts  upon  the  subject  aircraft. 
The  subject  aircraft  was  either  a Cessna  150  or  a Piper  PA-28  and  the  inter- 
ceptor aircraft  was  either  a Cherokee  180  or  a Beechcraft  Bonanza.  Subject 
pilots  were  in  voice  contact  with  the  test  control  room  at  all  times  and 
were  asked  to  immediately  report  all  traffic  sightings.  The  time  of  each 
sighting  of  the  interceptor  was  recorded  by  scan  (one  DABS  antenna  scan  is 
approximately  4 seconds  duration) . 

The  following  data  were  recorded  on  magnetic  tape: 

- precise  times  for  all  data-link  transactions 

- aircraft  radar  positions  for  each  scan  (including  altitude  reports) 

- IPC/PW1  messages  for  each  scan 

- aircraft  position  and  velocity  estimates  from  the  IPC  tracker  for 
each  scan 
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In  order  to  provide  for  the  effective  analysis  of  the  large  volume  of 
data  so  produced,  an  IPC  data  base  capability  was  developed  so  that  data 
for  all  IPC  encounters  could  be  made  available  for  analysis  in  a single 
processing  environment.  In  order  to  accomplish  this  goal  software  was 
written  which  scanned  the  tapes  from  each  IPC  mission  and  selected  data 
from  periods  of  critical  IPC  activity.  This  selected  data  was  then  trans- 
ferred to  a single  data  base  tape.  Handwritten  notes  produced  during  the 
mission  were  coded  and  typed  into  a data  file  on  magnetic  disk.  Software 
was  then  written  which  matched  tape  data  and  disk  data  and  provided  both 
to  the  user  simultaneously  under  the  IBM  370  Conversational  Monitor 
System  (CMS) . 

5 . 2 Non-Par ametric  Prese n ration  of  IPC/PW1  FI ight  Test  Data 

It  is  possible  to  construct  for  the  1PC/PWI  flight  test  data  a non- 
parametric  plot  of  acquisition  rate,  X,  just  as  was  done  for  the  CDC 
flight  test  data  and  the  simulation  data.  But  rather  than  plot  X against 
target  range,  \ will  be  plotted  versus  the  solid  angle  subtended  by  the 
target.  Calculation  of  the  solid  angle  requires  an  estimate  of  the 
visible  area  of  the  target  as  well  as  its  range.  An  algorithm  for  the 
approximate  calculation  of  target  visible  area  has  been  developed  for 
this  purpose  and  is  described  in  Appendix  B.  The  resulting  X plot  is 
shown  in  Fig.  5-1.  One-sigma  estimation  errors  are  shown  for  each  data 
point.  The  expected  linear  relationship  between  X and  the  solid  angle  is 


indeed  evident. 
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At  this  point  it  is  assumed  that  the  usefulness  of  the  proposed 
model  which  assumes  a linear  relationship  between  acquisition  rate  and 
target  solid  angle  (i.e.,  X = BA/r^)  has  been  demonstrated.  Values  of  8 
which  are  appropriate  for  different  search  conditions  may  now  be  derived 
from  test  data.  This  relationship  may  also  be  used  for  the  study  of  the 
significance  of  factors  which  are  not  explicitly  included  in  the  model.  A 
useful  tool  in  this  regard  is  the  special  statistic  defined  in  the  next 
section. 

5 . 3 Scanwise  Factor  Analys isj__  The  z Statistic 

Suppose  that  special  search  conditions  prevailed  for  m scans  of  data, 

and  that  it  is  desired  to  determine  whether  acquisition  performance  for 

those  m scans  is  better  or  worse  than  expected  from  the  proposed  model. 

Let  the  probability  as  calculated  from  the  model  that  acquisition  will 

occur  on  a given  scan  j be  p^ . When  the  acquisition  rate  X is  small 

p.  = X,T.  Otherwise  write  p.  = 1 - exp(-  X.T).  Define  an  acquisition 
J j J J 

indicator  Y.  such  that 


,0  if  no  acquisition  occurred  on  scan  j 
Y.  =< 

^ H if  acquisition  did  occur  on  scan  j 
For  the  m selected  scans  consider  the  sum 


number  of  acquisitions  which  occurred 
during  the  m scans 


Since  each  Y.  is  assumed  to  be  a statistically  independent  random 
variable  the  variance  of  the  sum  is  simply  the  sum  of  the  individual 


2d 


variances , 


°s  -vlsl- 


pj  <1-p1) 


The  expected  value  of  S is  likewise 


E [S]  = 


E[YJ]  = 


m 


The  z statistic  is  now  defined  as  the  deviation  of  the  actual  number 
of  acquisitions  from  the  number  expected  from  the  model  (expressed  in 
standard  deviations  of  S) , i.e.. 


S - E [ S ] 


Since  there  are  typically  a large  number  of  scans  in  each  analyzed 
group,  it  may  be  assumed  (by  the  central  limit  theorem)  that  the  distribution 
of  z approximates  that  of  a standard  normal  random  variable.  This  is  true 
however  only  when  the  acquisition  performance  is  well  characterized  by  the 
model  employed.  When  the  z statistic  differs  from  zero  by  several  units 
a significant  departure  from  the  assumed  model  is  indicated. 

5.3.1  Ana  lysis  of  Target  Area  Dependence 
The  basic  model  which  has  been  adopted  assumes  that  the  acquisition 
rate  is  proportional  to  the  solid  angle  subtended  by  the  target  and  hence, 
for  a given  range,  is  proportional  to  the  visible  area  of  the  target. 

Since  the  visible  area  varies  greatly  with  the  aspect  angle,  it  then 
becomes  necessary  to  incorporate,  visible  area  into  the  model  for  the 
acquisition  rate.  For  this  reason  an  algorithm  for  the  approximate  calcu- 
lation of  visible  area  was  developed  (see  Appendix  B) . As  a check  upon 
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both  the  assumption  of  visible  area  dependence  and  the  area  calculation 


algorithm,  the  z statistic  may  be  utilized  for  the  analysis  of  visible  area 
dependence.  For  this  purpose  the  model  must  regress  slightly  to  a simpler 
formulation  which  assumes  that  the  acquisition  rate  is  a function  of  range 
only,  i.e. , 


2 2 * 

A = 8/r  where  8 = .10  nmi  /sec  . 

All  available  scans  of  data  are  then  divided  into  groups  corresponding  to 
25  square  foot  intervals  of  calculated  visible  area,  and  one  then  finds 
the  z-statistic  for  each  group.  The  results  of  this  analysis  are  given  in 
Fig.  5-2.  There  is  indeed  a trend  toward  increasing  z with  increasing 
visible  area.  Thus,  the  z-analysis  supports  the  assumption  that  the 
acquisition  rate  should  include  a dependence  upon  visible  area  and  not 
range  alone. 

5.3.2  Analysis  of  Cockpit  Visibility  Effects 
In  Section  1.2  the  visibility  obstructions  present  in  the  aircraft 
cockpit  were  mentioned  as  factors  in  visual  acquisition  failures.  In  the 
analysis  of  visual  acquisition  performance  it  is  helpful  to  identify  those 
cases  in  which  acquisition  was  hindered  by  the  cockpit  visibility  limitations. 
Figure  5-3  is  a plot  of  the  visibility  from  the  Piper  PA-28  cockpit.  Note 
the  greater  angular  area  which  exists  on  the  side  of  the  aircraft  on  which 
the  pilot  is  sitting  and  the  decreased  visibility  for  approaches  rear  of 
the  opposite  (right)  wing.  Unfortunately,  such  plots  are  valid  for  only  a 
single  position  of  the  pilot  within  the  cockpit.  Since  pilot  position 
within  the  cockpit  may  vary  considerably  (especially  if  the  pilot  is 

* 

This  value  of  8 was  obtained  from  inspection  of  Figs.  4-1  and  4-2.  Its 
exact  value  is  not  critical  to  the  question  under  consideration. 
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alerted  to  an  approaching  threat  within  an  obstructed  sector)  the  recorded 
test  data  is  inadequate  to  reliably  determine  whether  the  pilot's  view  is 
obstructed  on  a particular  scan.  However,  the  z-statistic  may  be  utilized 
to  examine  the  statistical  dependence  of  the  acquisition  rate  upon  the 
approach  bearing,  and  thus  evaluate  the  severity  of  impact  of  obstructions 
upon  acquisition  performance  in  terms  of  performance  variations  with  approach 
direction . 

In  Fig.  5-4  the  z-statistic  is  plotted  versus  target  approach  bearing 
(in  30°  intervals) . Note  that  very  little  degradation  in  performance  occurs 
for  bearings  between  -160°  and  +90°.  However,  beyond  +90°  there  is  a 
significant  trend  toward  poorer  acquisition  performance.  This  is  under- 
standable since  subject  pilots  sat  in  the  left  seat  of  the  test  aircraft. 

When  alerted  a pilot  could  turn  to  search  areas  quite  far  to  his  left,  but 
there  was  little  he  could  do  to  overcome  the  visibility  problems  posed  by 
aircraft  approaching  from  his  right. 

5 . 4 Estimation  of  Mod  el  Parameter  Val  ues 

The  IPG  flight  test  data  will  now  be  utilized  to  estimate  the  values 
of  the  constant  B in  the  expression  for  the  visual  acquisition  rate.  B 
will  be  estimated  by  applying  equation  (3-11)  in  the  form 


n t . 

E f 

i=l  Jo 


(5-2) 


Since  the  value  of  8 may  vary  as  the  conditions  of  the  search  are 
changed,  different  values  of  8 must  be  calculated  for  different  search 


conditions.  When  a specific  condition  is  specified  then  the  value  of  N 
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-STATISTIC  (STANDARD  DEVIATION) 


in  Equation  5-2  must  include  only  those  acquisitions  occurring  while  the 
condition  was  satisfied.  Similarly  the  integral  in  the  denominator  is 
restricted  to  those  time  intervals  in  which  the  specified  condition  was 
satisfied . 

Search  conditions  will  be  specified  in  the  following  terms: 

1.  Approach  azimuth  - As  the  analysis  of  Section  5.3.1  has  shown 
the  visibility  of  the  pilot  is  severely  restricted  beyond  +120° 
in  azimuth.  We  will  therefore  provide  an  option  for  separate 
consideration  of  scans  upon  which  the  target  azimuth  exceeded 
+120°. 

2.  Alert  status  - A pilot  is  said  to  be  unalerted  if  he  has  received 
neither  a flashing  nor  non-flashing  PWI  alert.  He  is  said  to  be 
in  the  PWI-only  state  if  he  has  received  a PWI  alert  but  no 
command.  He  is  in  command  state  if  he  has  received  positive 

or  negative  IPC  collision  avoidance  commands.  For  the  IPC 
system,  the  presence  of  commands  implies  that  a PWI  indica- 
tion is  also  present. 

Derived  B values  for  several  sets  of  search  conditions  are  displayed 
in  Table  5-1.  The  values  of  cases  1 and  2 are  of  greatest  interest  since 
they  correspond  to  "pure"  alerted  and  unalerted  and  alerted  search  which  is 
little  modified  by  airframe  obstruction.  The  lower  value  of  B during  command 
periods  (case  3)  reflects  the  fact  that  with  commands  the  pilot  was  forced 
to  devote  a considerable  fraction  of  his  time  to  monitoring  the  display, 
acknowledging,  and  maneuvering  the  aircraft.  The  motion  of  the  aircraft 
during  turns  also  causes  the  PWT  position  to  lag  the  actual  target  bearing 


TABLE  5-1 


B Values  for  Selected  Search  Conditions 
(Approach  Azimuths  from  -160°  to  +120°) 


Case 


Alert  Status 


Unalerted 

PWI-only 

Commands  (with  PW1) 


. 


Jl 
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with  a consequent  decreased  usefulness  of  the  PWI  information.  The 
acquisition  rate  during  command  periods  is  thus  approximately  one-third 
of  the  value  for  the  PWI-only  periods. 

We  may  now  compare  these  values  with  the  corresponding  values  for 
the  CDC  flight  test  data  of  Figs.  4-1,  4-2,  and  4-3.  The  comparison  cannot 
be  exact  since  we  must  assume  a value  for  the  visible  area  for  the  CDC 
curves.  For  a target  visible  area  of  75  square  feet  the  value  of  B would 
be : 


.15  nmi^/sec 
75  ft2 


- 7.4  x 10  /sec 


This  value  is  consistent  with  the  6 value  of  subject  pilots  alerted 
by  PWI  (S  = 9 x 10^ /sec). 
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VISUAL  ACQUISITION  PERFORMANCE  PREDICTIONS 


6 . 1 Techniques  for  Adapting  Model  to  Various  Search  Conditions 
The  results  of  the  preceding  section  will  now  serve  as  a basis  for 
the  construction  of  a model  of  visual  acquisition  which  will  be  used  to 
predict  acquisition  performance  for  a wide  range  of  conditions.  The  basic 
observation  upon  which  the  model  is  based  is  that  visual  acquisition  is 
characterized  by  an  acquisition  rate.  A,  which  is  proportional  to  the 
solid  angle  of  the  target,  i.e., 

A = 6 A/r2  (6-1) 

where 

6 = a model  parameter  depending  upon  the  search  conditions 
A = the  visible  area  of  the  target 
r = the  range  from  observer  to  target 
Since  the  value  of  6 depends  upon  search  conditions,  a complete 
computational  model  must  alter  8 when  search  conditions  change  (e.g.,  when 
the  pilot  moves  from  unalerted  to  alerted  status).  It  is  also  desirable 
to  specify  certain  modifications  which  allow  the  model  to  be  adjusted  for 
search  conditions  which  differ  slightly  from  those  for  which  test  data  is 
available.  In  the  paragraphs  which  follow  several  such  modifications  are 
suggested.  Although  caution  must  be  exercised  in  modifying  the  model  for 
conditions  which  differ  greatly  from  those  for  which  it  lias  been  validated, 
the  results  so  obtained  still  prove  useful  for  a first  investigation  of 
parametric  dependencies. 

Modification  Due  to  Fractional  Search  Time 

Suppose  that  the  value  of  the  model  parameter  corresponding  to  constant 

search  is  8 . If  the  pilot  spends  only  a fraction  k of  his  time  searching 
o 


l 
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then  the  effective  value  of  B will  be  lower  than  Bq  by  the  factor  k, 
i.e.,  B = B^k.  This  simple  correction  is  valid  when  the  pilot  frequently 
glances  from  inside  the  cockpit  to  outside,  and  thus  spends  a relatively 
uniform  amount  of  time  searching  at  each  target  range  interval.  If  the 
pilot  spends  long  intervals  looking  inside  the  cockpit,  then  the  distribu- 
tion of  durations  of  these  intervals  must  be  taken  into  account. 
Modification  for  Search  Area  Size 

As  argued  in  Section  2.2,  the  acquisition  rate  should  be  inversely 

proportional  to  the  size  of  the  angular  area  which  the  pilot  is  searching. 

In  the  IPC/PWI  flight  tests,  the  PWI  instrument  resolution  was  30°  and 

the  pilots  were  briefed  to  expect  targets  to  appear  occasionally  in  sectors 

adjacent  to  the  alarm  sector  due  to  normal  system  errors.  Although  the 

actual  area  searched  varied  from  pilot  to  pilot,  most  pilots  seemed  to 

search  a sector  of  60°  to  90°  centered  upon  the  sector  of  the  PWI  alarm. 

If  we  denote  the  area  of  the  search  for  the  IPC/PWI  system  as  S then  the 

o 

acquisition  rate  for  a system  with  search  area  S must  be  modified  by  the 

ratio  S /S. 
o 

Modification  for  Atmospheric  Visibility 

In  Section  2.3  data  was  quoted  which  indicated  that  targets  with 

similar  contrast-size  products  possessed  similar  detection  properties. 

Since  the  effect  of  atmospheric  visibility  is  to  decrease  contrast  the  net 

effect  upon  the  acquisition  rate  should  be  to  reduce  the  rate  by  the  same 

proportion.  A corresponding  increase  in  target  size  is  then  required  to 

restore  the  original  contrast-size  product.  Thus,  one  may  utilize  the 

-3 . 92r 

contrast  reduction,  exp[ — — ] , as  a factor  in  modifying  Equation  6-1. 

K 
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Conditions  Requiring  Zero  Acquisition  Rate 

In  applying  the  Equation  6-1  there  are  two  conditions  under  which  the 
acquisition  rate  must  be  set  to  zero.  The  first  and  most  obvious  condition 
is  when  the  target  is  obstructed  by  the  airframe,  and  therefore  is  not 
within  the  pilot's  field  of  view.  The  second  condition  is  when  the  size 
of  the  target  is  less  than  the  resolution  limit  of  the  human  eye.  For 
conditions  of  daylight  brightness  (1000  foot  lamberts)  this  limit  is 
approximately  one  minute  of  arc. 

The  values  to  be  used  for  the  model  parameters  may  be  based  upon 

Table  5-1.  Cumulative  probabilities  of  acquisition  can  then  be  calculated 

via  Equation  3-2  using  numerical  integration.  The  model  described  above  is 

summarized  in  Table  6-1.  It  should  be  noted  that  no  attempt  has  been  made 

to  specify  the  precise  value  of  S to  which  the  8 values  correspond.  This 

o o 

is  of  no  consequence  if  one  wishes  to  predict  performance  for  a system  with 

the  same  resolution  as  the  IPC/PWI  system  (then  S/S  = 1).  For  a system 

o 

with  a different  search  sector  size  however,  a value  for  the  ratio  S/S 


must  be  postulated. 


TABLE  6-1 


Acquisition  Rate 


k r-3.92r,  „ A 

* = TsTFT  exp  1 R Bo~T 

o r 


Cumulative  Probability  of  Acquisition: 


P (t)  = 1 - exp  [-/C  X (r)  dr,] 


Parameter  Values  Derived  from  IPC/PWI 


4 . 

B k = 1 x LO  /sec  for  unalerted  pilots 


Mod  if ied 
acquisition 
model  for  use 
in  performance 
calculat  ions 
. (see  text  for 


exp  1 anal  ion ) 


B - 9 x 10  /sec  for  alerted  pilots 
o 

(k  * 1) 
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For  the  following  series  of  calculations  it  is  assumed  that  aircraft 
are  flying  on  collision  courses  (zero  miss  distance)  at  constant  altitudes 
with  constant  headings.  The  closure  rate  and  the  visible  areas  presented 
by  each  are  then  constant.  It  will  be  assumed  that  the  PWI  system  alerts 
the  pilot  whenever  the  range  or  the  time  until  collision  drops  below  speci- 
fied thresholds.  (For  the  IPC/PWI  system  typical  thresholds  are  2 nautical 
miles  and  45-75  seconds.  Because  of  the  delay  required  for  message  trans- 
mission and  display,  it  is  assumed  that  the  period  of  alerted  search 
begins  at  40-70  seconds  before  collision)  . 

6.2  Single  Pilot  Search 

Acquisition  performance  for  encounters  between  two  single  engine 
general  aviation  aircraft  with  airspeeds  of  100  knots  (a  typical  cruising 
speed)  will  be  considered  first.  For  zero  miss  distance  trajectories  the 
closure  speed  and  the  visible  area  can  be  determined  as  a function  of  the 
crossing  angle  (difference  in  headings)  of  the  aircraft.  Figure  6-1  gives 
the  cumulative  probability  of  acquisition  for  an  unalerted  pilot  for 
encounters  at  various  crossing  angles.  The  increased  closure  rates  and 
decreased  visible  areas  which  are  associated  with  the  larger  crossing 
angles  dramatically  decrease  the  probability  of  acquisition  with  sufficient 
lead  time.  These  curves  indicate  that  separation  by  unaided  visual  means 
can  be  highly  effective  only  for  the  lowest  crossing  angles. 

Figure  6-2  provides  acquisition  performance  curves  for  the  same 
encounter  trajectories  except  that  now  it  is  assumed  that  the  pilot  is 
alerted  by  a PWI  system  so  that  alerted  search  begins  at  40  seconds 
before  collision.  (Thus,  I rom  Table  5-1,  the  acquisition  rate  increases 
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TIME  TO  COLLISION  (SEC) 

Fig. 6-1.  Predicted  acquisition  performance  for  unalerted  search  by 
single  pilot. 


by  a factor  of  nine  at  t = 40) . For  the  larger  crossing  angles  the  prob- 
ability of  acquisition  with  sufficient  lead  time  is  increased  severalfold. 
However,  it  sill  appears  that  acquisition  performance  is  adequate  only  for 
lower  crossing  angles  (below  90°) . 

A general  set  of  curves  which  can  be  readily  applied  to  a range  of 
encounter  situations  can  be  derived  if  we  assume  that  acquisition  does  not 
occur  before  the  pilot  is  alerted.  (Otherwise,  the  PWI  alert  is  super- 
fluous) . If  the  aircraft  are  on  a collision  course  so  that  the  range  is 
r(t)  = -r  t where  r is  the  range  rate  and  t is  the  time  until  collision 
and  if  search  begins  at  tQ , then  the  probability  of  n£  acquisition  by  time 
t is 


where  T = BA/r  is  a constant  for  a particular  encounter.  Two  sets  of 
a 

curves  depicting  the  resulting  probabilities  of  acquisition  for  different 

alert  times  are  presented  in  Figs.  6-3  and  6-4.  The  constant  T is  a 

a 

characteristic  acquisition  time  since  it  represents  the  time-to-collision 
at  which  the  probability  of  no  acquisition  drops  to  e ^ (36.8%)  for  a 
search  begun  at  infinity  (t ^ = °°) . The  quantity  e a/  o is  the  factor  by 
which  the  probability  of  no  acquisition  has  been  increased  by  failure  to 
begin  searching  at  infinity.  This  expression  is  relevant  to  the  determina- 
tion of  suitable  PWI  warning  thresholds.  Suppose  for  instance  that 
acquisition  failure  is  said  to  occur  whenever  the  pilot  fails  to  acquire 
before  some  critical  time-to-collision,  t ^ . Let  the  PWI  system  alert  the 
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PROBABILITY  OF  ACQUISITION 
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RATIO  OF  WARNING  TIME  TO  REQUIRED  ACQUISITION  TIME 


Fig. 6-5.  Probability  of  late  acquisition  as  a function  of  warning  time 
( t , = m i n imum  ad  equate  time-to -collision  of  acquisition,  T = BA/r 2 ) . 
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pilot  at  time  tQ  = kt^.  The  probability  of  failure  to  acquire  by  t^ 
is  then 


The  resulting  failure  rate  is  plotted  in  Fig.  6-5.  It  is  seen  that  no 
matter  how  early  the  pilot  is  alerted,  it  is  impossible  to  decrease  the 

_T  t 

failure  rate  below  e a/  1.  Furthermore,  as  k is  increased  beyond  3 or  4, 
very  little  decrease  in  the  failure  rate  is  to  be  expected  for  critical 
cases.  Thus,  a reasonable  objective  for  a PWI  system  which  wishes  to  achieve 
near  maximum  effectiveness  without  excessively  early  alarms  is  to  provide 
a search  time  which  is  about  three  times  the  minimum  acceptable  acquisition 
lead  time.  If  acquisition  must  occur  by  15-20  seconds  before  collision,  then 
a warning  threshold  of  45-60  seconds  is  appropriate. 

6 . 3 Two  Pilot  Search 

Up  to  this  point  visual  acquisition  performance  has  been  discussed 
in  terms  of  a single  searching  pilot.  However,  at  least  two  pilots  are 
involved  in  every  collision,  and  it  might  be  assumed  that  if  either  pilot 
acquires  his  traffic  he  will  act  to  avert  a collision.  In  that  case,  one 
must  consider  the  cumulative  probability  for  acquisition  by  a_t  least  orie 
of  two  pilots.  In  order  to  do  this,  note  that  the  probability  of  no  acquisi- 
tion by  pilot  It  1 at  by  time  t may  be  written 

P^(t)  = exp  [-/^  (O  df]  where  is 

the  acquisition  rate  for  pilot  1 against  aircraft  2.  Similarly,  for  pilot 
2 against  aircraft  1 write 

P2(t)=  exp  l-/o  \2  (O  d4] 
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PROBABILITY  OF  AT  LEAST  ONE  PILOT  ACQUIRING 


ATC-73 (6-6 ) I 


Fig. 6-6.  Probability  of  acquisition  by  either  pilot  (two  small  aircraft 
alerted  search  beginning  at  ^0  seconds  to  collision). 


t 


Then,  under  the  assumption  the t the  acquisition  probabilities  are  statis- 
tically independent,  the  probability  of  no  acquisition  by  either  aircraft 
becomes 


P]P2  = exp  [-/o  l\L  (O  + X2  U)]  d ] 


Thus,  the  effective  rate  for  acquisition  by  either  of  two  pilots  is  just 
the  sum  of  the  acquisition  rates  for  each  pilot  separately.  Acquisition 
probabilities  for  two  pilot  search  are  presented  in  Fig.  6-b  for  two 
100  kt  aircraft.  The  marginal  performance  at  higher  crossing  angles  that 
was  noted  in  previous  cases  is  still  evident. 

Consider  now  two-pilot  curves  for  encounters  between  a large  jet 
(e.g.,  Boeing  727)  and  a single  engine  general  aviation  aircraft  (e.g., 
Piper  PA-28) . Let  the  small  aircraft  have  an  airspeed  of  100  kts  and 
the  larger  an  airspeed  of  250  kts.  The  resulting  cumulative  probabilities 
of  acquisition  are  given  in  Fig.  6-7.  Note  that  although  the  closure  rates 
are  now  greater  due  to  the  speed  of  the  jet  aircraft,  the  increased  size 
of  the  faster  aircraft  more  than  compensates  for  this  (e.g.  , head-on  the 
closure  rate  is  a factor  350/250  = 1.75  greater,  but  the  visible  area  is 
a factor  330/20  = 16  greater). 

Before  becoming  too  encouraged  by  this  trend  one  should  note  that  the 
disparate  speeds  of  the  aircraft  can  lead  to  special  difficulties.  For 
instance,  in  the  previous  case  of  equal  speed  aircraft,  the  approach  bear- 
ings of  the  threat  tended  to  be  within  90°  of  the  aircraft  nose,  thus 
allowing  a high  probability  of  unobstructed  viewing  by  both  pilots.  In 
the  current  case,  as  crossing  angles  drop  below  45°,  the  faster  aircraft 


tends  to  approach  from  behind  at  bearings  for  which  obstruction  is  a 
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Fig. 6-7.  Probability  of  acquisition  by  eit her  pilot  (sma II  s I ow  a i rcraf t 
vs.  large  fast  aircraft,  alerted  search  beginning  at  70  seconds  to  collision 
unobstructed  approach). 


problem.  Obstruction  is  especially  likely  if  the  faster  aircraft  approaches 
from  the  side  opposite  to  the  pilot.  When  such  obstruction  exists,  the 
pilot  who  is  attempting  to  acquire  the  large  target  (330  sq.  ft.)  cannot 
search  effectively  and  the  responsibility  for  acquisition  rests  upon  the 
pilot  who  must  search  for  a small  target  (20  sq . ft.).  In  this  situation 
one  must  employ  single-pilot  acquisition  curves  and  utilize  a small  value 
for  the  visible  area.  As  an  example,  for  the  "tail  chase”  overtake  rate 
of  150  kts,  we  may  apply  the  curves  of  Fig.  6-5  to  find  that  the  overtaking 
pilot  has  only  a 77  per  cent  chance  of  acquiring  the  small  aircraft  before 
15  seconds  to  collision. 

A related  consideration  which  applies  to  the  unobstructed  cases  is 
that  because  of  the  size  differences  the  small  aircraft  is  much  more  likely 
to  acquire  the  larger  than  vice-versa  (range  and  range-rate  being  necessarily 
equal  for  the  two.)  Experience  obtained  during  the  IPC  flight  tests  indi- 
cates that  it  is  more  difficult  to  evaluate  and  avoid  a threat  that  is 
faster  than  oneself  than  it  is  to  evaluate  and  avoid  threats  of  equal  or 
slower  speed.  Whether  or  not  this  consideration  is  significant  in  off- 
setting the  benefits  of  the  earlier  acquisition  times  achieved  against 
larger  aircraft  is  beyond  the  scope  of  this  investigation. 

6.4  PWI  Compatibility  Considerati  >ns 

k 

The  IPC  system  provides  PWI  service  and  collision  avoidance  service 
via  a common  display.  Both  services  .ire  intended  to  aid  the  pilot  in  avoiding 
other  aircraft,  but  each  achieves  its  goal  in  a quite  different  manner.  The 
two  services  can  be  complementary,  but  they  can  also  interfere  with  each 

k 

The  term  collision  avoidance  system  is  used  to  designate  a system  which 
provides  instructions  (commands)  to  the  pilot  which  tell  him  to  maneuver 
in  specific  directions  to  avoid  a collision. 
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ocher.  In  Section  5.4  it  was  indicated  that  the  issuance  of  collision 
avoidance  commands  decreased  the  rate  of  visual  acquisition  by  returning 
the  pilot's  attention  to  the  instrument  panel  and  forcing  turns  which 
induce  bearing  lag  in  the  PWI  indication.  Collision  avoidance  commands 
can  also  make  visual  avoidance  redundant  if  commands  are  consistently 
issued  at  ranges  which  are  too  great  for  visual  avoidance  to  play  a role. 

On  the  other  hand,  pilots  may  be  reluctant  to  follow  commands  once  the  PWI 
has  allowed  them  to  visually  acquire  their  traffic.  This  is  especially  true 
if  the  commands  turn  them  in  a way  that  breaks  visual  contact. 

The  visual  acquisition  model  developed  in  the  study  may  be  utilized 
to  allow  a quantitative  evaluation  of  the  relationship  between  collision 
avoidance  system  parameters  and  PWI  utility.  A further  discussion  of  these 
issues  is  available  in  the  IPC  flight  test  documentation  (References  11  and 
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7 • CONCLUSIONS 

It  has  been  shown  that  despite  the  inherent  complexity  of  the  air-to- 
air  visual  acquisition  task,  the  available  test  data  can  be  well  modeled 
statistically  as  a Poisson  process  in  which  the  acquisition  rate  is  pro- 
portional to  the  solid  angle  subtended  by  the  target  for  which  the  pilot 
is  searching.  The  constant  of  proportionality  as  determined  from  the  IPC 
flight  tests  is  10000/steradian-sec  for  unalerted  search  and  90000/stera- 
dian-sec  for  alerted  search  (thus  the  presence  of  a PWI  alert  increases 
the  acquisition  rate  by  a factor  of  nine)  . Consideration  of  the  nature 
of  the  acquisition  process  suggests  that  this  basic  result  can  be  modified 
to  account  for  the  effects  of  other  variables  such  as  fraction  of  time 
devoted  to  search,  angular  area  of  search,  and  atmospheric  visibility. 

The  model  has  been  applied  to  the  prediction  of  visual  acquisition 
performance  for  typical  encounter  situations  and  suggests  the  following 
conclusions : 

(1)  Unaided  visual  acquisition  is  effective  as  a means  of  separation 
assurance  only  for  lower  values  of  crossing  angles  (relative 
heading) . At  higher  values  of  crossing  angle  the  increased 
closure  speeds  and  decreased  visible  areas  reduce  performance 
considerably . 

(2)  PWI  alarms  increase  the  probability  of  acquisition  by  several- 
fold for  the  most  adverse  conditions,  but  fail  to  achieve  more 
than  a 50-80%  cumulative  probability  of  acquisition  with  adequate 
warning  time. 

(3)  In  typical  cases  the  increased  size  of  jet  transport  aircraft 
more  than  compensates  for  their  increased  speed,  resulting  in 
their  being  acquired  at  greater  ranges  than  smaller,  slower 
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aircraft.  However,  large  speed  differences  increase  the 


? 


probability  of  a tail-chase  encounter  in  which  the  faster 
aircraft  overtakes  the  slower  from  a bearing  in  which  pilot 
view  is  obstructed. 

(4)  Increasing  PWI  warning  times  beyond  40-60  seconds  to  collision 
has  little  effect  upon  the  ultimate  probability  of  acquisition 
since  the  angular  size  of  the  target  at  earlier  times  is  much 

] 

less. 

(5)  Issuance  of  IPC  commands  appears  to  interfere  with  the  visual 
acquisition  process,  lowering  the  acquisition  rate  by  a factor 
of  three.  This  is  probably  due  to  the  fact  that  commands  return 
the  pilot's  attention  to  the  instrument  panel  and  result  in  turns 
that  create  PWI  bearing  lag. 


APPENDIX  A 


MAXIMUM  LIKELHOOD  ESTIMATION  OF  MODEL  PARAMETERS 


In  Section  3-2  the  dependence  of  the  acquisition  rate  A(x)  upon  the 


vector  x was  w itten  in  the  parametric  form 


A(x)  = 6.x  + 60x  + ...  + 6 x 

II  2 2 mm 


(A-l ) 


The  proper  values  of  the  parameters  6.  for  a given  set  of  data  is  to 


be  found  by  the  method  of  maximum  likelihood.  The  maximum  likelihood 


estimates  of  the  6 ^ are  those  values  which  maximize  the  likelihood  function 


of  Equation  3-10.  This  function  may  be  written  in  the  following  form: 


L(t  , t , ....  t ) 
12  n 


| | [ 1-Yi  + Y1  A(ti)J  exp[-n(ti)]  (A-2 ) 


_ 0 if  the  trial  terminated  at  t.  without  acquisition, 

i 1 


l if  the  trial  terminated  ac  t^  with  acquisition. 


Since  log  L is  a monotonic  function  of  L and  thus  obtains  its  maximum 


at  the  same  6 value  as  L,  one  may  choose  to  maximize 


l°g  L = y llo8(l-  Y.  + Y.  Aft.))  - n(t.) 


(A-3) 


The  m stationary  conditions  necessary  for  obtaining  a maximum  of  log  L 


are  given  by 


9 X ( C i ) 


1 - Y1+Yl*(t1)  a 6 


0 1 = 1,2 m 


(A -4) 
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When  the  derivatives  on  the  right-hand  side  are  evaluated  using  the 
definition  of  \ of  equation  (A-l)  and  the  definition  of  n of  Equation  (J-7) 


one  obtains 


'n  T Y tf 

= ^ v 1 - + YiA(ti)  Xj(Ci)  ( Xj  ( ^ i ) d 0 

i=i  L J0 


j = 1 , 2 , . . . , m (A-5) 


These  m equations  may  be  solved  iteratively  using  a digital  computer. 
But  consider  the  simplest  case  in  which  only  one  variable,  x^  , is  present. 


1 - Y.  + Y . A ( t . ) Xi(ti) 
i i i J 


0 ifYi=° 


1 if  Yf  = 1 


(A-6) 


and  the  maximum  likelihood  estimate  of  g is  thus 


- £ Yi 


i=l  0 


f1 

j xl(o 


n t . 

£f 

i=l 


x^OdS  (A-7) 


where  N is  the  number  of  the  n trials  which  terminated  in  acquisition. 
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APPENDIX  B 

A TECHNIQUE  FOR  THE  DETERMINATION  OF  VISIBLE.  AREA 


The  calculation  of  the  visible  area  presented  by  a complex  three- 
dimensional  object  such  as  an  airplane  when  seen  from  an  arbitrary 
direction  is  complicated  by  the  fact  that  the  various  surfaces  are  seen  at 
different  angles  and  often  shield  one  another.  However,  a rather  simple 
but  apparently  adequate  approximation  technique  for  determination  of 
visible  area  will  now  be  described.  Note  first  that  the  direction  (bearing 
and  elevation)  of  aircraft  A as  seen  from  aircraft  B also  defines  the 
direction  at  which  the  line  of  sight  from  A strikes  B.  Thus  the  routine 
used  for  calculating  traffic  direction  also  yields  the  return  line-of- 
sight.  Consider  now  an  aircraft  centered  coordinate  axis  as  shown 
in  Fig.  B-l.  Let  the  visible  areas  seen  from  the  x (head-on)  y (broadside) 
and  z (above)  axe.?  be  A? , A^ , and  A^  respectively. 


A , head-on  area 

x 


A , broadside  area 
y 


|atC-73(B-1) 


A , above  area 
z 


Fig.  B-l.  Visible  areas  as  viewed  from  three 
principal  coordinate  axes. 
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The  aircraft  may  now  be  treated  as  if  it  were  an  object  consisting 

of  only  three  perpendicular  planar  surfaces  A , A , and  A . When  viewed 

x y z 

from  an  arbitrary  direction  the  visible  area  presented  by  a single  planar 

surface  is  simply  the  area  of  that  surface  multiplied  by  the  cosine  of  the 

angle  between  the  1 ine-of-sight  and  the  normal  to  the  surface.  Denote  the 

three  individual  areas  so  calculated  as  A',  A',  and  A'.  Due  to  shielding 

x y z " 

the  actual  visible  area  is  less  than  the  sum  of  the  three  individual  areas. 
We  will  approximate  the  shielding  effect  as  follows: 

visible  area  = max(A',  A',  A')  + 1/3  of  remaining  areas. 

x y z ° 

The  1/3  factor  compensates  in  an  approximate  manner  for  the  effects 
of  shielding.  Note  that  this  approximation  is  errorless  when  the  aircraft 
is  viewed  along  any  of  the  principal  coordinate  axes.  Principal  areas  for 
typical  aircraft  are  given  in  Table  B-l.  Insofar  as  aircraft  shape  in 
invariant  with  wingspan,  these  figures  may  be  extended  to  other  aircraft  by 
assuming  that  each  area  increases  as  the  square  of  the  wingspan  of  the  air- 
craft. 


TABLE  B-l 

type  aircraft  wingspan  head-on  broadside  above 


s ingle-engine 
general 
aviat ion 
JPiper  PA-28) 



32  ft 

2 

20  ft 

1 

2 

100  ft 

. - 

2 

220  ft 

1 ■'  j 

y 

) 

mult i -engine 
jet 

transport 
(Boeing  727) 

108  ft 

330  ft 

lb30  ft 

3100  ft 
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